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tridiagonaJ  matrices,  and  let  UST4(>i)  denote  that  subset  of  UST(n) 
with  positive  0,. 

We  wish  to  develop  an  algorithm  to  reconstruct  T  from  the  knowledge 
of  two  of  its  eigenpairs  (A,u)  and  (/i,v).  The  eigenvector  recurrence  for 
symmetric  tridiagonal  matrices  is 

+  o.u,  + /J,u,+  i  -  Au,  (2) 

where  (A,  u)  is  any  eigenpair  of  T,  u.  is  the  ith  element  of  u,  and  0o  = 
0n  =  0.  Applying  this  relation  to  both  eigenpairs  gives 

+  Q.U.  +  ^,U,4l  =  Au, 

+  o,i>,  +  5,i'.+i  =  pt'f 

Combining  these  two  equations  and  eliminating  a,  gives 

[ 

^,_i(n,u,_i  -  -  t>,+(U,)  s  (A  -  (3) 

Since  0q  s:  0„  =  0  we  get  the  following  initial  and  terminal  conditions 

I 

I 

-  tijui)  =  (A-p)uifi  (4) 

-  Unt>„_i)  =  (A  -  MjUnVn.  (5) 

Combining  (3)  with  (4)  gives  a  special  c^e  of  the  Christoffel-Darboux 
identity, 

I 

^.(u.+if,  -  i;,+iu,)  =  (A  ^  Ukt'k  (6) 

kml 

for  i  =  l,2,...,n  -  1.  There  is  also  a  backtlard  formula, 

I 

n 

^.{u.+  lW.  -  W, +  !«,)=  -(A  -  p)  ^2  (^) 

kx-f  I 

which  follows  from  (3)  and  (5),  or  from  (6)  and  the  orthogonality  of  the 
eigenvectors.  In  a  similar  manner,  we  can  show  that 

3a,tt,t;,  =  (A  +  p)u,»,  -  +  t),u,_r)  -  ^i(«i4iWi  +  (8) 

This  formula  uses  all  of  the  available  information  but  it  is  possible  to 
obtain  an  equation  for  the  a,  using  the  0,  and  a  single  eigenpair  with  the 
formula 

ttiV,  s  -  ^,v,4f  (9) 

We  can  use  these  equations  to  reconstruct  the  original  matrix  from  the 
two  eigenpairs  provided  that  no  element  of  the  two  eigenvectors  is  zero 


I 


and  that  t',u,4i  -  u,t>,4i  ^  0  for  any  t  =  1,2,  ...,n  -  1.  If  this  is  true,  then 
the  equations  for  the  a,  simplify  to 


2a.  =  (A  +  p)  -  0..,  -  0. 

\  t),  U,  J  \  V,  u,  / 


(10) 


o,  —  A  —  0t^ 


U.4I 


U>  U. 


(11) 


Notice  that  (10)  is  just  the  simple  average  of  (11)  over  both  eigenpairs. 
Using  (11),  (6),  and  (7)  we  can  reconstruct  the  original  matrix  in  13n  -9 
flops, 

In  order  to  determine  when  these  formulas  can  be  applied,  we  need 
some  additional  results.  We  introduce  the  following  fact  from  [lO], 


Fact  1  Let  T  €  UST+fn)  and  assume  that  the  eigenvalues  ore  ordered 
so  that  Ai  >  Aj  >  ...  >  A„.  Then  the  number  of  sign  changes  between 
consecutive  elements  of  the  kth  eigenvector  ofT,  denoted  St,  is  it  —  1. 


We  refer  the  reader  to  [lO]  for  a  proof  but  note  that  it  can  be  derived 
from  the  Sturm  sequence  property  for  the  cha '.acteristic  polynomials  of  the 
principal  submatrices.  With  this  fact  in  hand  we  can  prove  the  following 
theorem. 


Theorem  1  // T  €  UST+(«)  and  i/(A,u)  and  (/i,v)  are  the  extremal 
eigenpairs  ofT,  that  is  A  =  Ai  and  p  s  An.  then  v.u.fi  —  +  1  #  0  for 

any  i  =  1,2,  ...,ti  -  1. 

Proof  The  proof  follows  trivially  b.  noting  that  the  strict  interlacing 
property  for  unreduced  symmetric  tridiagonals  (see  [12]  p.  300)  guaran¬ 
tees  that  none  of  the  numbers  Ui,Ui4i,t>i,  v.^i  can  be  zero.  And,  since  u, 
and  11,41  must  have  the  same  sign  and  v,  and  v,4i  must  have  opposite 
signs  (from  fact  1),  it  follows  that  both  terms  in  u,v,4)  —  v,u,4i  have 
opposite  signs  and  are  nonzero  so  this  difference  is  really  a  sum  of  two 
strictly  positive  (negative)  numbers  and  hence  is  not  zero.  D 

Hence,  if  we  choose  the  two  extremal  eigenpairs  of  a  given  element  of 
UST4  we  can  always  reconstruct  the  original  matrix  using  the  formulas 
above.  Notice  that  the  denominator  is  computed  without  cancellation  in 
this  case  because  of  the  sign  pattern.  Moreover,  if  we  use  the  smallest 
(largest)  eigenpair  in  (9)  to  get  the  a,,  then  these  can  be  reconstructed 
from  the  derived  0,  and  the  data  without  further  cancellation  if  the  matrix 
is  positive  (negative)  definite.  If  the  matrix  is  indefinite  then  there  is  only 
one  additional  cancellation  for  each  of  the  a,.  If  the  matrix  is  singulai 
then  choosing  the  eigenvector  associated  with  the  zero  eigenvalue  prevents 
further  cancellation. 

Note  that  any  element  of  UST(n)  has  exactly  2n  —  1  real  degrees  of 
freedom  and  that  two  eigenpairs  contain  2n  -f  2  numbers  but,  in  fact,  also 
have  2n  -  1  real  degrees  of  freedom  since  there  are  two  arbitrary  scaling 
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parameters  for  the  eigenvectors  and  a  single  orthogonality  condition.  The 
eigenpairs  contain  precisely  the  right  amount  of  information. 

This  algorithm  is  especially  robust  when  applied  to  the  tridiagonal 
matrix  associated  with  the  bidiagonal  SVD.  It  is  well  known  [7]  that  the 
Jordan-Lancros  matrix 


A  = 


0  J5’' 

B  0 


(12) 


where  B  £  jf"*"  ig  unreduced  bidiagonal  with  positive  elements,  can 
be  reduced  via  the  perfect  shuffle  to  an  unreduced  tridiagonal  T  of  the 
form 


0 

01  0  03 


0n~\ 
0n.l  0 


(13) 


The  matrix  T  is  2n  x  2ii  and  its  eigenvalues  occur  in  plus-minus  pairs. 
It  is  not  difficult  tc  show  that  if  (A,u)  is  an  eigenpair  of  T  then  (-A.Su) 
is  also  an  eigenpair  where  5  is  diagonal  with  1  and  -1  alternating  as  the 
diagonal  elements.  The  reconstruction  formula  for  this  matrix  simplifies 
considerably  since  we  need  only  a  single  eigenpair.  In  particular,  the  0, 
are  given  by 


0,  - - ^(-l)*ui.uk  (14) 

U14.1U,  ^ 

As  a  special  case  of  the  more  general  algorithm  it  is  obvious  that  the 
denominator  v.^iu,  is  not  zero  provided  we  use  the  eigenvector  associated 
with  the  largest  eigenvalue.  Even  more  intriguing  is  that,  provided  none 
of  the  principal  submatrices  shares  an  eigenvalue  with  the  full  matrix, 
this  denominator  will  be  non-zero  for  any  eigenpair  since  in  this  case  no 
element  of  any  eigenvector  can  be  zero.  In  other  words,  the  reconstruction 
from  any  eigenpair  is  well-posed  provided  that  the  given  eigenvector  has 
no  zero  elements.  The  algorithm  requires  Sri  —  7  flops  working  with  (14) 
and  the  backward  equation 


0. 


(-1)'*'A 


•41 

y^(-i)*u>uk. 

Aan 


(15) 


Notice  that  this  matrix  has  only  n  —  1  real  degrees  of  freedom  which 
is  exactly  what  is  given  by  one  eigenpair  since  the  eigenvector  contains 
an  arbitrary  scaling  parameter  and  must  satisfy  the  special  orthogonality 
condition 
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(16) 


^(-1)'»?  =  0. 

•  Bl 

We  point  out  that  this  algorithm  can  be  interpreted  as  the  reconstruc¬ 
tion  of  an  unreduced  bidiagonal  B  from  its  largest  singular  value  and  both 
associated  singular  vectors. 


2  Arrow  Matrices 


W'e  can  reconstruct  the  arrow  matrix  in  a  similar  manner  to  that  given 
above.  The  arrow  is  of  some  importance  as  it  occurs  in  certain  divide  and 
conquer  schemes  for  finding  the  eigenvalues  of  a  tridiagonal  matrix  [l,  8}. 
The  arrow  is  also  an  element  of  the  class  of  symmetric  acyclic  matrices 
(as  is  the  Jacobi  matrix)  and  hence  it  is  possible  to  find  its  eigenvalues 
with  “tiny  componentwise  relative  backward  error",  (5). 

The  general  form  of  an  arrow  matrix  is 


A  = 


“i  ^1  1 

oj  /9j  I 


■*n-l  0n-l 
01  02  0n-i  1 


(17) 


U  0,  ^  0  for  i  =  <,3 . n  -  I  and  if  a,  Oj  for  any  t  yf  )  then 

we  shall  say  that  A  €  USA(n),  where  US.*,  .'n)  is  the  set  of  unreduced 
symmetric  arrow  matrices.  Proceeding  before,  we  let  (A,u)  and  (p,v) 
be  two  eigenpairs  of  A.  The  eigenvectoi  recurrence  is 


a,u, -f  5iU„  =  Au,  (18) 

Qit’. +  /?it’n  =  (19) 

for  i  =  l,2,...,n  —  1.  Moreover,  the  eigenvector  relation  also  gives 

n— I 

y  =  #* — (20) 

fvl 

for  any  eigenpair  (p,v)  of  A.  If  we  combine  (18)  and  (19)  and  eliminate 
we  get 


^.{ViUn  -  tt.tin)  =  (A  - /i)u,»,.  (21) 

Similarly,  eliminating  0,  gives 

o,(v,u„  -  u,t)„)  -  Mf.ttn  -  Au,t>„.  (22) 

This  gives  a  very  simple,  easily  vectorizable  reconstruction  algorithm. 
The  only  remaining  question  is  whether  the  quantities  ii„u,  —  «„v,  are  all 
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nonzero.  In  order  to  ■  how  that  this  is  true  under  the  correct  conditions,  we 
need  to  first  establish  some  facts  about  the  eigenvectors  of  an  unreduced 
arrow  matrix.  We  begin  by  noting  that 


a;  = 


D-Xl  b 

7  -  A 


(23) 


where  D  =  diag(oi,oj . On-i).  and  b  =  [di,  02,  ■  Following 

[8]  we  compute  the  Gauss  factorization 


'  D- XI 

b 

r  /  oi 

D- XI 

b 

o’- 

7-A  J 

7 

11 

o’- 

-/(A)  J 
( 

where  /,  the  spectral  function,  is  given  by 


/(A)  =  A-7+^^^.  (25) 

••1  ' 

From  (24)  and  (25)  the  zeros  of  /  are  the  eigenvalues  of  A.  Further¬ 
more,  if  A  is  unreduced,  then  the  eigenvalues  of  A  are  strictly  interlaced 
by  the  a,.  It  follows  that  the  eigenvector  associated  with  A  is 


v{A)  = 


(A/  -  J5)-'b 

1 


(26) 


Note  that  distinctness  of  the  Oi  is  critical  since  it  guarantees  that  (A/-  D) 
is  nonsingular.  Combining  this  description  of  the  eigenvectors  with  the 
fact  that  the  a,  interlace  the  eigenvalues,  we  have  the  following  fact 


Fact  2  Let  A  be  an  unreduced  arrow  matrix  with  0,  >  0  for  i  =  1,2, n  — 
1.  Then  the  following  hold. 


I.  If  M  is  any  eigenvector  of  A  then  u,  /  0  for  any  i  =  1,2 . ri. 

S.  If  we  order  the  eigenvalues  of  A  so  that  Ai  >  Aj  >  ...  >  An  and 
let  Ut  be  the  eigenvector,  from  (SC),  associated  with  As,  (fieri  the 
first  k  —  1  elements  of  Uk  are  less  than  zero,  and  the  last  n  -  A  -h  1 
elements  are  greater  than  zero. 

Proof,  The  proof  of  the  first  fact  follows  directly  from  formula  (26) 
and  the  interlacing  property.  The  second  fact  follows  from  formula  (26), 
the  interlacing  property,  and  the  positivity  of  the  /?,.  □ 

This  simplifies  the  reconstruction  formula  since,  if  we  assume  that  the 
eigenvectors  are  normalized  so  that  their  last  elements  are  equal  to  one, 
the  reconstruction  formulas  can  be  rewritten  as 


a.  =  A-lii^ 
t*i  -  ». 


6 


0, 


(27) 


1 


(/I  -  A)u.f. 

u,  -  t», 


,-(,-x)y:-^ 

^  ti  -  »• 


Using  tiiese  formulas,  we  can  reconstruct  the  arrow  matrix  in  lOn  —  8 
flops.  Under  the  previously  mentioned  conditions,  it  is  easily  shown  that 
none  of  the  denominators  in  the  reconstruction  formula  are  zero  and  hence 
we  can  always  reconstruct  the  matrix  from  two  eigenpairs. 

Theorem  2  IJ  A  ii  an  unreduced  arrow  matrix,  and  if  A  and  fi  are  any 
two  distinct  tiffenvalues  of  A  with  associated  eiyentiec/orj  u  and  v,  nor- 
malited  to  have  their  last  elements  equal  to  one,  then  u,  —  v,  5^  0  for 
1  =  1,2 . «-l. 

Proof.  Assume  that  u,  =  t>,.  The  eigenvector  relation  implies  that 


Ut 

1 

Au, 

I’l 

1 

u.  j ' 

pi'. 

which  implies  that  A  =  p,  but  this  contradicts  the  distinctness  of  the 
eigenvalues.  Hence,  it  follows  that  u,  i',.  D 

The  reconstruction  algorithm  has  another  very  important  property;  if 
the  two  extremal  eigenpairs  (A)  and  An  and  their  associated  eigenvectors) 
are  used,  then  the  0,  can  be  found,  up  to  the  scaling  factor  Aj  —  An, 
without  cancellation.  This  follows  from  the  fact  that  if  the  corresponding 
eigenvectors  are  normalized  so  that  their  last  elements  are  both  one.  then 
all  the  remaining  elements  must  have  opposite  signs.  This  is  fortuitous 
since  it  means  that  the  differences  that  appear  in  the  denominator  do  not 
involve  ca.icellation.  Moreover,  if  A  is  indefinite  there  are  no  cancellations 
whatsoever  in  computing  the  0,.  Conversely,  if  A  is  definite  there  are  no 
cancellations  in  computing  the  o,.  If  A  is  semi-definite  (and  singular) 
then  there  is  no  cancellation  at  all,  including  the  computation  of  7.  The 
computation  of  7  involves  one  cancellation  if  the  matrix  is  indefinite,  and 
none  if  it  is  definite,  or  semi-definite,  provided  we  choose  the  correct  eigen¬ 
vector  for  its  computation.  In  any  case,  whenever  there  is  cancellation  in 
this  algorithm,  it  is  benign. 


3  Breakdown  of  the  Jacobi  reconstruc¬ 
tion 

On  feeing  that  the  reconstruction  algorithm  for  the  arrow  is  well  posed 
for  any  two  eigenpairs,  it  is  tempting  to  believe  that  this  might  also  be 
the  case  for  the  Jacobi  matrix  algorithm  since  the  tame  conditions  apply 
-  unreduced,  no  principal  tubmatrix  shares  an  eigenvalue  with  the  full 
matrix.  Unfortunately,  it  is  not  true.  Consider  the  matrix 
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(29) 


■  C  2  0  O' 

2  4  5  0 

0  5  4  2 

.  0  0  2  6  . 

which  i$  an  element  of  UST^.  and  satisfies  the  condition  that  no  principal 
submatrix  shares  an  eigenvalue  with  the  full  matrix.  The  eigenvalues  of 
this  matrix  are  10,  (5  +  V65)/2,  5,  (5  —  v/6^)/2  and  the  eigenvectors 
associated  with  10  and  5  are  (12  2  1]^  and  [-2  1  1  —  2)^,  respectively. 
Note  that  the  reconstruction  algorithm  breaks  down  for  these  two  eigen- 
pairs  and  cannot  uniquely  determine  02.  Some  manipulation  of  the  scalar 
equations  shows  that  the  two  eigenpairs  in  question  arc  eigenpairs  of  any 
matrix  of  the  form 


'  6  2  0  0  ■ 

2  9-7  7  0 

0  7  9-7  2 

0  0  2  6 


(30) 


Fortunately,  we  can  say  a  few  things  about  breakdown.  First  of  all, 
if  the  algorithm  breaks  d-'wn  in  the  co  mputation  of  0,  then  it  cannot 
break  down  in  the  computation  of  0,-t  or  0,.^i  since  this  implies  that 
two  distinct  eigenvalues  share  the  same  eigenvector.  Second,  if  there  is  a 
breakdown  then  it  is  possible  to  reconstruct  a  parametrized  matrix  with 
the  specified  eigenpairs  by  setting  0,  —  and  solving  for  or,  and  0,41 
in  terms  of  7.  Setting  7  =  0  will  yield  a  reduced  tridiagonal  with  the 
specified  eigenpairs. 


4  Stabilizing  divide  and  conquer  algo¬ 
rithms 


We  note  that  there  are  several  other  important  inverse  problems  for  the 
symmetric  arrow  matrix.  Of  interest,  is  the  reconstruction  of  the  sym¬ 
metric  arrow  from  the  eigenvalues  and  the  thajt  of  the  arrow  (i.e,  the 
elements  a,).  In  this  case  it  is  also  possible  to  reconstruct  the  arrow  in 
a  straightforward  manner  since  we  need  only  determine  the  0,  and  the 
element  7.  Clearly,  we  can  obtain  7  from  the  trace  formula,  that  is 

91  f»~l 

•■I 

The  0,  can  be  computed  directly  since  the  —0^  are  the  residues  of  the 
partial  /ruction  decomposition 


/W  = 


nr..  (*-■»■) 


(32) 


Thus  we  have 


^?=  li. 

'  A  — 


m  (o*  -  A)/(A)  = 

Oft 


nr=,K-A.) 


(33) 


This  algorithm  is  used  in  [3]  for  the  reconstruction  of  a  periodic  Jacobi 
matrix.  It  can  also  be  applied  to  stabilize  the  extension  based  tridiagonal 
divide  and  conquer  algorithms  [1,  8]. 

We  note  that  this  is  very  similar  with  the  inverse  problem  first  con¬ 
sidered  in  [2]  and  then  used  in  [9]  to  stabilize  the  modification  based 
Cuppen-Dongarra-Sorensen  algorithm  [4.  6].  In  particular,  the  zeros  of 
the  spfctral  Juurtiou 


fiX)  =  ;+y-^ 

4^  O,  — 


(34) 


are  the  eigenvalues  of  D  -h  bb^.  The  authors  of  [9]  show  that  loss  of 
orthogonality  in  computing  the  eigenvectors  can  ble  avoided  by  using  the 
computed  eigenvalues  A,  in  the  reconstruction  fortiiula 
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and  then  computing  the  eigenvectors  of  D  -f  iib  ;from  their  explicit  ex¬ 
pressions.  The  enlightened  use  of  s/ii/ls  of  the  origin  [9)  is  crucial  to  both 
algorithms.  i 
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